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ABSTRACT 

In a study of the effects of time restrictions and 
passage access on reading comprehension, 128 college freshmen 
enrolled in two different developmental readiag courses were divided 
into 4 groups of 32 subjects each. (Tests used to assess reading 
ability at the college level are usually either power tests with 
liberal time limits, or speed tests, which are strictly timed. Both 
provide access to the passage.) Group 1 had no passage access and no 
time limit; group 2 had no passage access and a 15 siinute limit; 
group 3 had passage access and no time . limit; and group 4 had passage 
eccess and a 15 minute limit. The results of this study conflict with 
those of other research, which support the findings that increased 
time restrictions do not yield higher test scores while passage 
access does. The two groups who had no time restrictions scored 
significantly higher than those with a 15 minute I.imit, and the two 
groups who had no passage access did just as well as the two groups 
who were permitted access. Across jill groins fbmrt were no 
significant differences between comprehension and retention scores. 
Several conclusions might be drawn from these results. Developmental 
college students have problems processing connected discourse and, as 
a result, their metacognitive abilities are weak, niough unrestricted 
time limits are often impossible, perhaps unrestricted time on 
reading tests would be benef icial« More research on developmental 
college students must be done before accurate conclusions can be 
drawn. (SRT) 
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The efifect of passage access and time 
restrictions on the comprehension and 
retention of connected discourse 

Sherrie h. Nlst and Mark C Hogrebe 
Unheisl^ of GcoifU 
Athens, GeoifU 

Tests used to assess reading ability at college level generally fisai into 
one of two categories — power tests or speed tests. Speed tests, such as the 
Nelson-Denny Reading Test ( 1976), are highly timed and provide a measure 
of vocabulary, comprehension and speed. Power tests, such as the McGraw- 
Hill Survey Test (1974), have more Uberal time limits and attempt to diagnose 
mom specific reading weaknesses. Both of these tests allow for passage 
access while answering the comprehension questions. But what efiTects do 
these two factors ~ time and passage access — - have on the assessment of 
reading comprehension for students enrolled in a college developmental 
reading program? 

Elements of Readintf TMti 

Reading tests tend to be product rather than process oriented. That is, 
the Information sought from the tests is usually a score instead of an 
assessment of ongofig reading strategies. Students are generally given a 
passage (or passages) to read and then are instructed to answer a series of 
questions about the selection, traditionally in a multiple-choice format The 
number of items correct yields a comprehension score based on a norming 
group. In most cases, students can refer back to the passage for verification 
or clarification when answering questions. It is assumed that passage 
access provides a better estimate of the amount comprehended since the 
memory aspect has been removed. 

The theoretical relationship between memory and reading compre- 
hension is interesting to explore, especially as it is related to the reading of 
connected discourse. It is indeed a complex relationship since it includes 
activating prior knowledge for initial understanding (Bransford & Johnson, 
1972), using deeper levels of processing so that information can get from 
short-term to long-term memory (Rundus, 1971>, and finally being able to 
retrieve the Information at the appropriate lime once it is placed in long-term 
memory (l>ilving & Pearlston, 1966). Because of this complex series of 
events, it is luundly surprising Uiat it is difficult to unravel all of these aspects 
and to determine just to what extent one affects the other. Research 
indicates that prior knowledge offiects the amount of Information compre- 
hended (Johnson, 1981}, but what effect does passage access have on an 
individual's ability to perform better on a test of reading comprehension? 
Common sense indicates that the answer to this question is obvious. That 
is, it seems certain that individuals would be able to do better on a series of 
multiple-choice questions if they were permitted access to the passage than 
if they were denied access. 

The research relating to the topic of access versus no access is scant 
and hence inconclusive. In fact, only two studies could be located which 
directly address this issue; only one of the two used college students as 
subjects. In investigating the advantages of studying summaries over actual 
text, Reder and Anderson ( 1979) permitted college subjects access to the text 
when answering a series of true/false questions. Even with text available, the 
mean accuracy rate in answering direct and indirect questions was very 
close indicating that access did not provide an advantage for questions 
whose answers were readily available in the text As a result of interviews 
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comhictfid ^th subjects, the researcbers concluded that passage access 
vros teoefidal onfy If studrats used a tjnpe of inf^^ 

Johnson (1981), however, found ttuit avaflability of text was an Impot- 
tant fiaictor In evaluatbi|{ reading compnshension. His findings indicated that 
students do t>etta* on questions testing peripheral information (details) 
when th^ have passage access but that access hinders conqirehension on 
questions testing cental information (main ideas). 

A related stu^ 1^ Gamer (198^ sought to determine if there was a 
difference between students who weie identified as good comprehenders 
and those who were poor comprehenders on their ability to lock up answers 
to interspersed que^ons if they were permitted passage access. Students in 
both groups were trafaied In facilitatiag comprehension using looMMicks. 
Gamer found that while tndoing and practice improved performance for all 
subjects, good comprehenders were nuKh more l&ely togobackand locdc up 
the answers to questions they did not Inow. 

While additional studies have hivestigated text lookbacks, the Reder 
and Anderson studty and the Johnson investigation are the onty ones which 
ha\'e dealt directly with the issue of access. Since they were conducted using 
different aged subjects and since the results were conflifftingp no generali* 
zations can be drawn* 

Greater consistency in findings exist in studies which have manipu- 
lated the time foctor. Generally subjects* performance does not significantly 
improve by permitting additional time. When Reder and Anderson increased 
the time sdlotment by 10 minutes for one group, no significant differences 
were present between the group who had 20 minutes and the group who had 
30 minutes. 

Similar findings occurred when Wld, Duiso, and Rubin ( 1962) investi- 
gated the effect of mcreased test-taking time on the Graduate Record Exam 
by ethnic groups, years out of school, and sex. Their results indicated that 
even ihou^ a larger portion of the examinees completed the test when fhey 
were allotted more time, the extra time did not differentially help any of the 
groups studied. 

Thus, the research dealing with passage access versus no passage 
access has produced conflicting evidence about the effects of these foctors 
on comprehension. Passage access may make a difference depcauling on the 
type of questions asked. The research on the time foctor, however, points to : 
the fact that increased time spent on the reading task yields dther no' 
significant increase in comprehension scores or only a veiy small increase. ^ 
Piiurpose of the Stu^ 

The purpose of this studyr was to answer the following questions; 

1. Would college developmental reading students perform better on a 
test of reading comprehension and subsequent retention if the time 
restrictions were removed? 

2. Would college developmental reading students perform better on a 
test of readihig comprehension and subsequent retention if they 
were allowed access to the passage? 

3. Would the interaction between passage access and time restriction 
produce significantly different comprehension and retention scores? 

MBTHODOLOQT 

Sul^ects 

The subjects for this study were 128 fireshmen students enrolled in 
several sections of either 096R or 098R, two different developmental reading 
courses offered at a ms^r university. The former course is for students who 
need additional help in obtaining reading fluency: the latter course utilizes a 
content area approach to reading and concentrates on teaching students 
how to process textual information. All of the subjects were accepted into , 
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•the daRetopmental studies program since their SAT scores and/or high 
school* grade point averages were below those needed for regular admission 
to the university. The airily of the subjects were of Caucasian background 
(74.6%); 51.7% of the students were male. The average Scholastic 
Aptitude Test Veibal (SAIV) score of the subjects was 360 and ranged from a 
low of 200 to a high of 590. The mean high school grade point average was 
2.61. 
Desitfa 

Subjects were randomly assigned to one of four treatment groups, each 
group containing 32 subjects. Group 1 had no passage ^access and no time 
limitations (NA/NT); Group 2 had no passage access and a 15 minute time 
limitation (NA/Tk (koup 3 had passage access and no time limitations 
(A/NT); and Group 4 had passage access anld a 15 minute time limitation 
(A/T). Bach participant was random^ ghren a packet of materials which 
contained directions for carrying out the task, the reading passage, and for 
those in Groups 3 and 4, the con^uehension questions. They were told to 
read the instructions carefiully and to ask questions concerning the task. All 
subjects then read a 1,000 word passage on hibernation and Immediately 
following the reading answered a series of 18 multiple-choice questions. One 
week following the initial reading of the passage sJl subjects were given the 
18 items on a retention test. Both the questions and the foils were reordered 
for the retention tasdc All groups were given as much time as needed during 
the retention task. The test-retest reliability of the test was .75 and the items 
were found to be passage dependent The intemal consistency of the entire 
testwas.72. 
Ana^jsis of lbs Data 

The present study^ was a 2 x 2 x 2 factorial design with two between- 
subjects variables and one within-subject variable (Myers, 1979, p. 210). The 
data were analyzed with the Biomedical computer program (BMDP, 1979) for 
analysis of variance and repeated measures. The comprdiension and re- 
tention measures were the two trial Cactors, while access and time were the 
grouping factors. 

RESULTS 

Table 1 shows the means and standard deviations for each group on the 
dependent variable. The two groups y^o had no time restrictions (A/NT and 
NA/NT> had a higher mean score on both comprehension and retention than 
the two groups who had the 15 minute time restriction (A/T and NA/T). 
However, there was no such pattern between the means for the access 
versus no access groups. Additionally, within each group, the means for 
comprehension and retention are very ^ose. 

Three main effects were tested in the stucfy. Only the time restriction 
main effect (T) was statistically significant F(l, 128) = 7.84, p = .006. The two 
groups who had no time restrictions during the initial reacUng of the passage 
scored significantly higher on the dependent variable than those who had 
the 15 minute time limitation. 

There was no main effect for access (A), F(l, 128) = 2.04, p = .155. 
Referring to the means for each group shown in Table 1, it can be seen that 
the two groups who did not have access performed similarly to the two 
groups who had passage access. 

Across all treatment groups there were no significant differences 
between comprehension and retention scores (R), F(l, 128) = .247, p = .620. 
Subjects tended to do just as well on the retention questions as thc^ did on 
the comprehension questions no matter what treatment they received. 

Finally, of the three interactions tested, none were found to be signifi- 
cant Implications of this finding will be addressed in the following section. 



Means and Standard Deviations for Bach Groop 
on the D^endent Variable 



Repeated Measure ' 

Comprehension Retention 

Standard Standard 
Qroup* Mean Deviation Mean Deviation 



1. NA/NT 

2. NA/T 

3. A/NT 

4. A/T 



11.15 
10.06 
11.88 
10.45 



2.02 
3.33 
1.83 
2.59 



10.73 
10.30 
1135 
10.33 



2.49 
2.91 
1.92 
235 



♦l. NA/NT: No Access; No Time Restrictions 

2. NA/T: No Access; 15 Minute Time Restriction 

3. A/NT: Access; No Tiine Restrictions 

4. A/T: Access; 15 Minute Time Restriction 

DISCUSSION 1 

The results of this stady conflict with other research on pflggage 
access and time restrictions. In fiurt, the literature consistently supports the 
finding that increased time restrictions do not yield higher test scores, bi 
this investiiiation the opposite was found to be tniia, Th#> tan gmtipa who 
no time restrictions scored significantiy higher thim the tivo0mq>sirtio had 
the 15 minute time limitation. Additionally* somie past research also Indi- 
cates that passage access does miOce a difference. That Is» those who are 
permitted access to a passage when answering series of comprehension 
items do s ignifi cantly better than those who do not have access. Again, the 
results of this stu^ do not support this finding. The two gcwps who had no 
passage access did just as well as the two groups who were pennitled access. 

It is also puzzling that across all groups there were no significant 
differences between comprehension and retention scores. This flnrfing 
conflicts with the theory of forgetting meaningful information (SpitaBer* 
1939). 

Finally, the lack of interactions is in direct conflict with theories of 
Information processing. More specifically, access with no time restrictions 
should allow for deeper levels of processing (Craik & lockhart 1972) and. 
therefore, better comprehension and recalL Access with time restrictions 
should allow for good perfomuunoe on the comfmhension queens since 
the subjects could glance back quickfy for cues, but less efficient recall 
because they did not have to process at a deeper leyeL 

When attempting to interpret these results^ the first important con- 
sideration to explore is the nature of the sample. Tiemey (1982). defines 
immature readers as those who tend to read superficially, have poor concen- 
tration, and use few rehearsal techniques when attempting to learn new 
material. The mi^rlty have weak metaoo^tive skills and. therefore, have a 
difficult time determining whether or not th^ understand what they read. 
Additionally, often yrhen they do recognize that they are having difficulty 
comprehending, they don*t know what to do about it. so th^ continue 
reading and become more lost or they simply give up. The subjects in this 
study certainly possessed these characteristics and thus, their reading 
processes iy>peared to differ from regularly oHfn|tti*d college students. The 
sample itself, therefore, may have been a determining fieuztor in the results. 

As was previously stated, the flEU^t that the two groups who were 
permitted passage access while answering the compxehension questions did 
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not do better than those who did not have passage access 
outcome of the atuffy« (ta the suifBM^e it seems that if indM 
portions of a passage for clarification or verification they would be able to 
answer more items eonectly, especially the group vrho had passage access 
and no time restrictions. There are several plausible answers why this did 
not occur which again may be due, in part, to the sample studied. First 
research in d icat es that good readers will reread parts of a text when they are 
imsure of an answer to a question or don*t understand a concept (i.e. Collins 
& Smith, 1980). Since the participants in this study had deficient reading 
skills, one of three things may have occurred: (a) students thoudit they 
knew the correct answer and, therefore, didn*t bother to look it up (a 
metacognition problem); (b) they were too ]azy. didn*t care enough about the 
task, and sinqdy guessed at the answen or (c) they didn*t know where in the 
text to locate the answer. All of these fiEu:tors have implications for how 
developmental college students must be taught to process information more 
efficiently and ieffiectively. These suggesoons will be discussed in the 
following section. 

Equallyinterestingwasthefindingthattherewas no main effect for the 
repeated measure (R). Spitzer^s classic study on the retention of meuiingful 
material revealed that after seven days students remembered about 38 
percent of the amount initially comprehended. Given the tad that baseline in 
the present study (baseline is defined as the average nuniber of correct items 
on the comprehension test taken immediately after reading the passage) was 
10.88, according to Spitzer's findings we would predict the subjects would 
only get about four answers correct However, the average score after seven 
days was 10.08, or 99.3% of baseline. 

One possible reason why retention scores did not differ significantly 
from comprehension scores is that developmental studies students may 
retain as much as th^ initially understand. Since they rarely interact with 
text and subsequently often remember very little of what they read tmless it 
is meaningful to them, it makes sense that they would be able to retain, for a 
week, limited iriformation fit>m the ixiitial read&g. That is, good ^ 
readily synthesize and organize large amounts of information during their 
initial reading. However, those with deficient processing skills focus on 
information which is meaningful to them, but may or may not be relevant to 
understanding and remembering the major concepts presented. Additional 
support for this argument can be seen by re-examining Tsble 1. The close 
means between conq>rehension scores for all groups perhi^ indicate that 
the su^ts used very similar processing strides regardless of their 
assigned treatment fflroup. Additional time or passage access did not ensure 
differential processing to deeper levels or the use of effective rehearsal 
strategies. Hence, while the groups differed in the way they were instructed 
to cany out the lask, their foigetdng curves were similar. 

The only statistically sl^ificant result of the study was the time toctor 
on the combined comprehension and retention data. Those who had no time 
limitations did slgnficantly better than those who had 15 minutes to 
complete the task. Again, this finding conflicts with previous research 
conducted on the effects of increased time aUotments. While the population 
studied maybe one reason fbr this finding, another exidanation may be that 
in other studies the time limitation was increased (Le., from 20 to 30 
minutes), but subjects did not have unlimited time. The fiEurt that the subjects 
in the present studyr were permitted as much time as they needed in oider to 
complete the task may have contributed to the statistical significance in the 
time variable. The unlimited time factor may have reduced anxiety con- 
siderably, or may have given the subjects the additional reading time they 



ne«W since dwdopmental students tend to read slowly ^ 

require more time to complettj the reading task. J' consequently 

!^J!!r^' ^ '»sed on the results. 

^^JUlS?.?^*^ students have problems processinff con- 

nected dLscourse. This is evidenced 1^ the fiuA^JS^iSo^ 
passage access when answering the MmpSSS S^d^ 

S^SS. Sffi^"^*^ than Sse SS^J^j^SSe 
acMss. Even with access and no time restrictions, the infonu^ 
was not piocessed sufficiently enough so that SStecoSoSk 
backtothepassagetoflndan^S^^ 

^' 2^!^?i*?*^^ processing, metacognitive abilities of 
S^^o*?^ ""^^Again. Sis eviS 

the fact that access produced no signifiaStdilferences. SSSS 

taow the answer to certain questions, the logical tE todo w)Sw 
be to return to the text and to look-up the fflMwer7SS£te fattS 
S; « ther ttought they knew the aLwer!^Ta2StoS?,M^t 
bou^ to look it up. or thqr attempted to look U i^S^ 

^' Si^ ta'liiSS !° appeared to retain as much as 

U^initiaUy understood as evidenced by the lack of aiaSmt 
d^erenj^ between comprehension and i«entio^ 

.tawstigailon before substantive condusions cm^ 
couege students. Only then can generalizations be drawn Th^irV^^!!!t 



References 

Bransford, J. D., & Johnson* NL K. ( 1972). Contextual prerequisites for understanding: 
Sonie investigations of comprehension and recaU. Jouxnal of Verba/ Learning 
and Verbal Betiavior, il, 717-726. 

Brown, J. L, Nelson, M. J.. & Denny. B. C. (1976). The Ate/son-JJenny reading test 
Boston: Houghton-MiflOin Company. 

CoUins. A.. & Smith. B. B. (September 1980). Teaching the process of reading comprc 
beasion (Technical Report No. 182). Champaitfa, Olinois: National histitute of 
Education. 

Craik, F. I. M.. & Lockhart, it S. (1972). Level of processing; A frameworlc for memoty 
research, Jounud of Verbal Leamingand Verbal BebaWor. ii. 671-684. 

Gamer; R. (1982). Resolving comprehension Dedlure through text lookbacks: Direct 
training and practice effects amonggood and poor comprehenders in giades six 
and eleven. Reading Psychology: An Intematiorud Quarterly, 221-231. 

Johnson, P. H. (1981). Prior Knowledge and reading comprehension test bias. Unpub- 
lished doctoral dissertation. University of Illinois. 

McGraw-Hill survey reading text (1974). Monterey. California: McGiaw-Hill PubUshinfl 
Company. * 

Myers. J. L. ( 1979). Fundaaentals of Experimental Design (3rd ed.). Boston: Allyn and 
Bacon, Inc. 

Reder. L. M., & Anderson. J. R. (1979). A contparlson of texts and their summaries: 
Memorial consequences. Pittsburgh. Pennsylvania: Camegie-MeUon University. 

Rundus. D. (1971). Analysis of rehearsal processes in free recall. Jbumal offiroeri- 
mental Psyc/ioiqgy; 59. 63-77. 

Spitzer. H. F. (1939) Studies in retention. Jburoa/ ofKducatfonai Psychology, 30, 641- 
646. 

Tlemey. R. J. (1982). Learning from text In A. Berger and H. A. Robinson (Eds.) 
Secondary school reading; ll7iatreseairJkrevvn/5ibrc/assxt)Oinpfacdce. Urbaiui, 
DUnois: BRIC Clearinghouse on Reading and Communication SkiUs and the 
National Conference on Research in Bnglish. 

Tulving. B.. & Peariston. 2. (1966). AvailabiUty versus accessibility of information in 
memory for words. Journal of Verbal Leamingand Verbal Behavior, 5, 381-391. 

Wild. C. L.. Durso. R.. & Rubin. D. B. ( 1982). Bffect of increased test-taking time on test 
scores by ethnic group, years out of school, and sex. Journal ofEducaUonal 
Measurement 19, 19-28. 



16 



